Handheld device wireless music streaming for gameplay

ABSTRACT

Systems and methods are disclosed for streaming of audio data of separate streams in at least two different formats. In some embodiments handheld game devices are in wireless communication and a first of the handheld game devices streams audio data during game play to a second of the handheld game devices. In some embodiments the audio data includes audio data from a plurality of streams of audio data. In some embodiments the streams of audio data include streams of audio data in different formats, generally different compressed formats, some of which may be selected based on whether a device includes circuitry specifically configured to decompress audio data in a specific data format.

BACKGROUND OF THE INVENTION

The present invention relates generally to streaming music over awireless connection, and more particularly to streaming music over awireless connection between two handheld video game devices.

Handheld video game devices provide a convenient platform for enjoymentof video game play by many. The small form factor allows for easytransport of the video game device, and for comfortable play in a widerange of environments, including those environments which may beunsuitable for video game play on console or large arcade-type devices.

Handheld game devices may also have wireless communication capability.The wireless communication capability may be convenient so as to allow auser of one device to be able to provide game programs, for example, toa handheld device of another user.

Some game programs, however, may utilize large amounts of data. Forexample, songs or other audio information may be provided by a game,either as background audio or as part of game play, and the songs orother audio information often may require large amounts of data, even incompressed form. Transfer of large amounts of data, however, from aprovider handheld device to a recipient handheld device prior to gameplay may unduly delay commencement and enjoyment of the game. Moreover,storing of large quantities of transferred data by the recipienthandheld device may unduly tax or exceed memory capacity of therecipient handheld device. In addition, a handheld device may facedifficulties in timely processing of game play instructions whilesubstantially simultaneously processing large amounts of data, such asaudio information of songs, even if the handheld device includesspecialized capability to process such audio information.

SUMMARY OF THE INVENTION

The invention provides for music streaming during game play for, forexample, handheld devices. In one aspect the invention provides a methodfor providing audio information from a first handheld device to a secondhandheld device during game play of an interactive multiplayer videogame engaged in by users of the first handheld device and the secondhandheld device, the first handheld device configured to execute programinstructions of the interactive multiplayer video game and the secondhandheld device also configured to execute program instructions of thegame, each of the first handheld device and the second handheld devicehaving wireless communications capability, comprising: executing atleast some program instructions of the interactive multiplayer videogame by the first handheld device; transmission of at least some audioinformation by the wireless communications capability of the firsthandheld device; executing at least some program instructions of theinteractive multiplayer video game by the second handheld device;reception by the wireless communications capability of the secondhandheld device of the at least some audio information transmitted bythe wireless communication capability of the first handheld device, thereception occurring after the second handheld device has executed atleast some of the program instructions of the interactive multiplayervideo game; providing an audio presentation by the second handhelddevice of the at least some audio information received by the secondhandheld device; and executing at least some further programinstructions of the interactive multiplayer video game by the firsthandheld device, the execution of the at least some further programinstructions occurring after the transmission of the at least some audioinformation by the wireless communications capability of the firsthandheld device.

In another aspect the invention provides a method for communicatingaudio information between a first handheld device and a second handhelddevice, the method comprising: providing a first audio stream in a firstdata format; providing a second audio stream in a second data format,the second data format being different from the first data format;combining the first audio stream and the second audio stream into anoutput stream; and transmitting the output stream from the firsthandheld device to the second handheld device.

In another aspect the invention provides a method for communicatingaudio information between a first handheld device and a second handhelddevice, the method comprising: receiving an input stream at the secondhandheld device from the first handheld device, the input streamincluding data of a first audio stream in a first format and data of asecond audio stream in a second format, the first data format and thesecond data format being different formats; buffering data of the firstaudio stream; buffering data of the second audio stream; and playing atleast one sound indicative of data of the first audio stream and data ofthe second audio stream.

In another aspect the invention provides an audio stream transmittingsystem for transmitting information from a first handheld device to asecond handheld device, the audio stream transmitting system comprising:a first buffer configured to receive a first audio stream in a firstformat; a second buffer configured to receive a second audio stream in asecond format, the second data format being different from the firstdata format; a processor configured to combine the first audio steam andthe second audio stream into an output stream; and a transmitting systemconfigured to transmit the output stream from the first handheld deviceto the second handheld device.

In another aspect the invention provides An audio stream receivingsystem for receiving information at a second handheld device from afirst handheld device, the audio stream receiving system comprising: areceiving system configured to receive an input stream from the secondhandheld device, where the input stream includes a first audio stream ina first format and a second audio stream in a second format, the seconddata format being different from the first data format; a processorconfigured to retrieve the first audio stream from the input stream andto store the first audio stream in a first buffer; the processorconfigured to retrieve the second audio stream from the input stream andto store the second audio stream in a second buffer; the processorconfigured to generate at least one audio signal indicative of the firstaudio stream and the second audio stream; and at least one speakerconfigured to play a sound indicative of the at least one audio signal.

These and other aspects of the invention are more fully comprehendedupon study of this disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates two handheld game devices utilizing wireless datacommunication to stream audio data in accordance with aspects of theinvention;

FIG. 2 is a block diagram of host circuitry relating to streaming ofaudio data in different formats in accordance with aspects of theinvention;

FIG. 3 is a block diagram of client circuitry relating to receiving andplaying streams of audio data in accordance with aspects of theinvention;

FIG. 4 is a flow diagram of a process for providing a data stream withdata of separate audio streams in accordance with aspects of theinvention;

FIG. 5 is a flow diagram of a process for receiving and playing audiodata of separate audio streams in accordance with aspects of theinvention;

FIG. 6 illustrates a further pair of handheld game devices utilizingwireless data communication to stream audio data in accordance withaspects of the invention;

FIG. 7 is a block diagram of a handheld device used in accordance withaspects of the invention;

FIG. 8 is a block diagram of a further embodiment of host circuitryrelating to streaming of audio data in different formats in accordancewith aspects of the invention;

FIG. 9 is a block diagram of a further embodiment of client circuitryrelating to receiving and playing streams of audio data in accordancewith aspects of the invention;

FIG. 10 is a flow diagram of a further embodiment of a process forprocessing a data stream with data of separate audio streams inaccordance with aspects of the invention;

FIG. 11 is a screen shot of a display of an example music game inaccordance with aspects of the invention; and

FIG. 12 is a flow diagram of an example music game in accordance withaspects of the invention.

DETAILED DESCRIPTION

FIG. 1 illustrates a first handheld device 111 and a second handhelddevice 113. Both handheld devices are configured for use as handheldvideo game devices, with each device including a display 115 at leastone user input device 117, and a speaker 119. As is often common withsuch devices, each device includes circuitry such as processingcircuitry for executing game instructions stored in a memory associatedwith the processing circuitry, circuitry for receiving user inputs,circuitry for driving the display, circuitry for driving the speaker,and circuitry for reading a memory, which may be a removable memory. Inaddition, each device includes wireless communication circuitry forwireless communication using an antenna 121.

Generally at least one of the handheld devices is provided a removablememory, such as provided by a game cartridge, with the removable memoryincluding the game instructions and possibly other data, such as audioinformation for use as part of or in conjunction with the game. The gameinstructions are commanded by the processing circuitry to be transferredto the memory associated with the processing circuitry as appropriatefor game play.

As shown in FIG. 1, the first handheld device provides data during gameplay to the second handheld device. More particularly, the firsthandheld device provides audio information during game play to thesecond handheld device. Accordingly, in many embodiments the processingcircuitry of the first handheld device is configured, usually by programinstructions, to command transmission during game play of the audioinformation to the second handheld device by way of the wirelesscommunication circuitry. The audio information, for example a song orvoice clip, may be provided to the first handheld device by theremovable memory in some embodiments or otherwise be provided to thefirst handheld device in other embodiments, for example by a microphoneand associated audio circuitry or by a computer or server from which thefirst handheld device downloads the audio information.

In some embodiments the first handheld device provides, for example bywireless transmission such as radio frequency transmission, audioinformation to a plurality of other handheld devices. Thus in variousembodiments the first handheld device may provide audio information tothree, or eight, or some other number of other handheld devices.

In some embodiments the first handheld device provides, generally bywireless transmission, audio information during game play to the secondhandheld device at discrete times or upon discrete occurrences, such asupon receipt of a request by user to do so. For example, audioinformation comprising a voice message may be provided by the firsthandheld device to the second handheld device at predefined times duringgame play, or upon a request by a user of the first handheld device todo so.

In many embodiments, however, the audio information is provided by thefirst handheld device during game play as a stream, with the audioinformation provided in a substantially continuous manner orsufficiently continuous that the second handheld device may temporarilybuffer some portions of the audio information to account for somediscontinuities in receipt of the audio information. The stream of audioinformation may be provided throughout game play or be provided duringdiscrete portions of game play.

As an example, audio information comprising a song, or tracks of a song,may be provided by the first handheld device to the second handhelddevice during game play of a game such as a music game. The music gamemay be a music game in which users of handheld devices attempt tooperate the handheld devices, or input devices data coupled to thehandheld devices, in conjunction with audio presentation of the song orin response to actuation instructions on a display of the handhelddevices. FIG. 11 shows a sample screen shot of a display in an examplemusic game. In the example music game, graphical symbols scroll, orfollow similar paths, shown in columnar format, across the display. Asillustrated the sample screen shot of FIG. 11 shows four graphicalsymbols 1121 a-d, each scrolling across the display in adjacent columnarpaths 1113 a-d. Audio presentation of the song is provided as thegraphical symbols scroll across the screen. As each graphical symbolreaches a predefined portion of the display, such as the portionindicated by action line 1119, the user is expected to operatepredetermined one or more input devices, with a graphical symbol in aparticular path denoting that at least one particular input device, orcombination of input devices, should be operated. In addition, as eachgraphical symbol may be considered as having some correspondence to anote, other portion of the song or other audio output, correspondingaudio presentation of the notes or portions of the song is provided ifthe user correctly operates the input devices. Thus, through operationof the input devices, the user may “play” the song on the handhelddevice. In various embodiments, users of handheld devices in wirelessdata communication may play the same song in a collaborative orcompetitive manner, with audio information of the song being providedduring game play from a first of handheld devices to a second of thehandheld devices.

FIG. 12 is a flow diagram of a process of a music game in accordancewith aspects of the invention. The music game may be, for example, theexample music game discussed with respect to FIG. 11. In block 1211 theprocess scrolls graphical symbols, representing notes, portions of asong, or other audio output, across a display. The process may alsoperform audio presentation of portions of the song in block 1211. Inmost embodiments the process also has a first handheld device provideaudio information of portions of the song, for example portions of thesong represented by the graphical symbols, and related portions of thesong, to a second handheld device, which receives, and buffers the audioinformation until play. In block 1213 the process determines if an inputrepresentative of a strum, for example representative of a strum of aguitar, is detected. If not, the process returns to block 1211.Otherwise in block 1215 the process determines if the input has a propertiming relationship to an instruction to a user, for example asdiscussed with respect to FIG. 11 when a graphical symbol representing anote has reached the action line. Also in block 1215 the processdetermines if other inputs are in appropriate states with respect to theinstruction to the user, for example that predefined input devices arein an appropriate state considering the columnar path of the note whichhas reached the action line. Both determinations can be considered adetermination as to whether the correct “note” was played at the correcttime. If the correct “note” was not played at the correct time theprocess returns to block 1211. If the correct “note” was played at thecorrect time, in block 1217 the process provides an audio presentationof the corresponding note or portion of the song and adjusts a pointscore of the user, generally by adding points to the user's point score.The process determines if the game is over in block 1219 (although itshould be recognized that the process may do so with respect to otherblocks of the process). If so, the process returns, otherwise theprocess goes to block 1211.

In some embodiments different portions of the audio information areprovided in different data formats, often compressed data formats. Forexample, the audio information may be provided as three separate audiotracks, with two of the audio tracks in one data format, such as an OggVorbis (Ogg) data format, and one of the audio tracks in another dataformat, such as an adaptive differential pulse code modulation (ADPCM)data format. Thus, during game play, for example of a music game inwhich users of the first and second handheld devices attempt to interactwith their handheld devices in conjunction with music, the firsthandheld device may stream audio information of a song to the secondhandheld device during game play, two tracks of audio information of thesong in Ogg format and one track of audio information of the song inADPCM format. Each of the tracks of the audio information of the songmay be streamed substantially simultaneously, for example with data ofeach track of the audio information interleaved as appropriate, possiblywith other data as well. Moreover, a data format of at least one of thetracks may be selected to be the same as a data format for which thesecond handheld device has specialized audio processing circuitry,thereby potentially reducing processing burdens on other processingcircuitry of the second handheld device.

FIG. 2 is a block diagram of an embodiment of circuitry associated withprovision of streams of audio information in accordance with aspects ofthe invention. The circuitry may be provided, for example, in a handhelddevice such as that of FIG. 1 or other handheld devices. The circuitryincludes a processing system 202 and a wireless communication system204. The processing system 202 receives three streams of audioinformation 206, 208, 210 and provides a combined stream of audioinformation 211, which includes data of the three streams of audioinformation 206, 208, 210. The first stream of audio information 206 isin a first data format, while the second stream of audio information 208and the third stream of audio information 210 are in a second dataformat. The processing system may receive data of the three streams ofaudio information from a memory, such as a removable memory coupled to ahandheld device, with the data stored in the removable memory asseparate tracks in the separate data formats. Alternatively, data of thethree streams of audio information may be stored in a one of theformats, or another format, and converted as appropriate to the formatsof the three streams of audio information by the processing system.

The wireless communication system 204 receives the combined stream ofaudio information 211, which includes data of the three streams of audioinformation 206, 208, 210. The wireless communication system 204includes circuitry for performing wireless communication, generallyincluding circuitry for formatting data for transmission, upconvertingthe data to a transmission frequency, and transmitting the data using anantenna 212. In one embodiment, communication system 204 is configuredto communicate wirelessly in accordance with an IEEE 802.11 standard forwireless networks, for example as in a Wi-Fi network. In otherembodiments, the communication system can communicate wirelessly usingother proprietary or standard protocols.

FIG. 3 is a schematic block diagram of circuitry associated withreception of streams of audio information, for example streams of audioinformation such as provided by the circuitry of FIG. 2, in accordancewith aspects of the invention. The circuitry may be provided, forexample, as part of the handheld device of FIG. 1 or as part of otherhandheld devices. The circuitry includes a wireless communication system304, a processor 305, a first buffer 315, a second buffer 317, a formatmodule 319, a sound generator 321 and a speaker 323. The wirelesscommunication system 304 is configured to receive wirelesscommunications via an antenna 301. The wireless communication system isalso configured to generally process the wireless communications bydownconverting, digitizing, sampling, and otherwise perform wirelesscommunications receiver and data processing functions. The wirelesscommunications can include data from multiple streams of audioinformation. The processor 305 receives data 303 from the wirelesscommunication system and separates streams of audio information in thedata into three streams of audio information 307, 309, 311. In theillustrated embodiment, one stream of audio information 307 has a firstdata format and is decompressed by a first decompressor 315. The othertwo streams of audio information 309, 311 have a second data format andare decompressed by a second decompressor 317. The format module 319receives audio data from both decompressors and formats the data into amultiple channel audio source. In the illustrated embodiment, the formatmodule 319 produces a multiple channel audio source having 16 channels.In other embodiments, other numbers of channels can be used. The soundgenerator 321 receives the multi-channel audio output from the formatmodule 319 and generates an analog audio output. The speaker 323produces sounds in accordance with the analog audio output.

In some embodiments operations of one or both decompressors areperformed by the processor, with the processor configured by programinstructions to perform decompression of data in a particular compressedformat. In some embodiments the format module, or other circuitry on thedevice, is configured to decompress data in a particular manner, such asdata in the first format or data in the second format. For example, inone embodiment the first decompressor is formed of hardware circuitry inthe format module and the second decompressor is formed of the processorbeing configured to perform decompression of the second format byexecuting program instructions. Thus, decompression by the firstdecompressor may be provided by specialized hardware circuitry whiledecompression by the second decompressor may be provided by softwareexecuting on a more general purpose processor. The use of both softwaredecompression and hardware decompression, if both are available, may beparticularly beneficial as doing so allows for decompression and timelyuse of quantities of audio information that may exceed decompressioncapabilities of an available hardware decompressor while notoverburdening processing capabilities of a more general purposeprocessor, which may required for other game processing.

FIG. 4 is a flowchart of a process for providing data including multipleaudio streams in accordance with aspects of the invention. The processmay be performed, for example, by the handheld device of FIG. 1, or atleast in part by the system of FIG. 2. In block 411 the processinitializes communications between two handheld devices. In someembodiments the operation of block 411 is performed as part of anotherprocess. In block 413 the process begins execution of a game, generallyby executing program instructions stored in memory. In blocks 415 a-cthe process provides three streams of audio data at approximately thesame time. In some embodiments, different streams of data are providedin at least two different data formats. In some embodiments thedifferent streams of data are retrieved from a game cartridge indifferent data formats, while in some embodiments the processadditionally formats the data from another data format. The processbuffers data from the different streams in block 417. The processtransmits the buffered data in block 419. The process thereafterreturns, although it should be recognized that in many embodiments theoperations of blocks 415-419 are generally continually performed for thestreams of data until approximate the end of game play.

FIG. 5 is a flowchart of a process for receiving and playing data ofaudio streams in accordance with aspects of the invention. In variousembodiments the process may be performed by the handheld device of FIG.1, or other handheld devices, or the by the system of FIG. 3. Theprocess receives a combined data stream in block 911. For the purposesof discussion of FIG. 5 the combined data stream includes data fromthree audio streams, although in various embodiments the combined datastream may include data from other numbers of audio streams. In block513 the process separates and stores the data stream in separatebuffers, with data from each of the audio streams in separate buffers.In some embodiments the buffers may be separate physical devices. Inmost embodiments, however, the buffers are different areas in the samememory device. The process formats data of each of the three datastreams for play at approximately the same time in blocks 515 a-c. Theprocess plays audio provided by the streams in block 517. The processthereafter returns, although it should be again recognized that theprocess in most embodiments continually performs operations of theprocess in a pipelined fashion throughout game play.

FIG. 6 illustrates a further embodiment of a first handheld device 607and a second handheld device 609 in wireless data communication for playof a multiplayer game. The first handheld device includes an upperhousing 611 and a lower housing 613, with the upper housing and lowerhousing coupled by a hinge 615, which includes a passage for electricalcoupling of the upper housing and the lower housing. The upper housingincludes a video display 617, speakers 625, and a microphone (notshown). The lower housing includes a set of buttons 629 and a touchscreen for use as input devices 631. Generally the first handheld deviceadditionally includes power and volume controls, as well as a firstmemory port and a second memory port, with the first memory portconfigured to receive a first type of memory cartridge, and the secondmemory port configured to receive a second type of memory cartridge.Internal to the lower housing of the first handheld device are one ormore processors and data buses, video display circuitry and applicabledrivers, audio generation circuitry and applicable drivers, wirelesscommunication circuitry, memory for use by the processor and drivers,and other circuitry. In some embodiments the handheld device is aNintendo DS or Nintendo DS Lite, both widely available in consumerelectronics retail outlets.

The first handheld device reads and processes information stored in agame cartridge placed in one of the two memory ports. The informationmay include, for example, an interactive music game. The processor ofthe handheld device processes the information and generates display dataand audio data using the information. The first handheld device mayprovide, through execution of program instructions of the information,standalone game play or, in conjunction with another handheld devicealso executing program instructions, multiplayer game play.

As shown in FIG. 6, the second handheld device has an external andinternal hardware configuration similar and generally the same as thefirst handheld device. The second handheld device may therefore providefor standalone game play or, in conjunction with the first handhelddevice, provide multiplayer game play. In multiplayer game play, thefirst handheld device and the second handheld device play the same gamesubstantially simultaneously, with users of the handheld devicescompeting or collaborating with each other in substantially real time.

In the embodiment of FIG. 6 the second handheld device does not have thesame game cartridge as the first handheld device. Instead, the secondhandheld device is a client of the first handheld device, and downloads,or receives, at least some game components for a game from the firsthandheld device. As illustrated in FIG. 6, the second handheld device isin data communication with the first handheld device via wirelesscapabilities. Generally, prior to multiplayer game play, the first andsecond handheld devices establish data communications, with the firsthandheld device transferring game executable instructions to the secondhandheld device. For example, the background and structure of aninteractive music game are transferred from the first handheld device tothe second handheld device prior to game play. In some embodiments,however, the second handheld device may have the game executableinstructions without transfer from the first handheld device, andtransfer of game executable instructions may not be performed.

During game play the first handheld device provides audio data to thesecond handheld device by way of the wireless communication circuitry.The audio data is provided in a streamed fashion during game play, withthe audio data being in at least two separate tracks in different dataformats. For example, in some embodiments the handheld devices includehardware circuitry for processing data in a first format, and one of thetwo separate tracks is provided in the first format. In some suchembodiments the hardware may only be able to process a predefinedquantity of audio data in a given time period, while the processor, orone of multiple processors in the event that the handheld devicesinclude multiple processors, may be able to process additional datasubstantially simultaneously. The handheld device may also includehardware circuitry for processing data in a second format, and the otherof the two separate tracks is provided in the second format. Thus, ineither case providing audio data in different formats may increaseoverall processing of audio information.

FIG. 7 is an example of a block diagram of a handheld game device inaccordance with one embodiment of the invention. The handheld gamedevice includes a bus 700 coupled to a wireless communication interface702, a cartridge interface 704, a processor 706, a user input/output(I/O) interface 708, an audio driver 710, a video driver 712, a videomemory 714 and a main memory 716. In some embodiments the processor 706is actually multiple processors, which may have separate data buses. Thevideo driver 712 is coupled directly to the video memory 714.

The handheld game device can communicate wirelessly with other handheldgame devices or other computing devices. In one embodiment, the wirelesscommunication interface is configured to use the IEEE 802.11 standardfor wireless networks, and may be a Wi-Fi communications interface. Insuch case, the handheld game device can use other services that might beprovided over a Wi-Fi network such as internet services. The cartridgeinterface is configured to communicate with a game cartridge providinggame instructions and game related storage/memory. The processor 706 isconfigured to communicate with each component coupled to the bus 700 andto execute game instructions. The user I/O interface 708 provides aninterface for receiving instructions from a user and providing gamedisplay information to the user. The audio driver 710 is configured toreceive audio information from a device on the bus and to turn thatinformation into one or more audio signals to be provided to an audiooutput device such as a speaker. The video driver 712 is configured toprovide game display information to the handheld game device user inconjunction with the user I/O interface. The video driver 712 can usethe video memory 714 to store the game display information. Theprocessor 706 and/or other devices on the bus 700 use the main memory716 to store information as needed. The main memory 716 can storeinformation such as game play instructions, user input, audioinformation, video information and configuration information. The mainmemory 716 can include both volatile and non-volatile memory.

FIG. 8 is a partial block diagram of a further embodiment of hostsystem, particularly as it relates to audio streaming, in accordancewith aspects of the invention. The host system includes a processingsystem 802 and a wireless communication system 804. The processingsystem 802 receives a first audio stream 806, a second audio stream 808and a third audio stream 810. Data of audio stream 806 is in a firstformat while data of audio streams 808 and 810 are in a second format.Processing system 802 includes three buffers 814, 816, 818 and aprocessor 820. Buffer 814 is coupled to audio stream 806, buffer 816 iscoupled to audio stream 808 and buffer 818 is connected to audio stream810. Buffers 814, 816 and 818 are also coupled to processor 820.

Wireless communication system 804 includes a buffer 822, a transceiver824 and an antenna 812. Buffer 822 is coupled to the processing system802 and to transceiver 824. Transceiver 824 is coupled to antenna 812.

In operation, the host system, or a portion of the host system, receivesaudio data in a first format and a second format. In the illustratedembodiment, the first format is ADPCM and the second format is Ogg. Eachaudio stream is received by the processing system and stored in abuffer. In the illustrated embodiment, audio stream 806 (ADPCM data) isstored in buffer 814 and audio streams 808 and 810 (Ogg data) are storedin buffers 816 and 818, respectively. Processor 820 retrieves audio datafrom buffers 814, 816 and 818 and combines the audio data into a singledata stream. Data from the single data stream can be stored in buffer822 within the wireless communication system 804. The transceiver 824can retrieve data from the buffer 822 and send it wirelessly via theantenna 812, with the transceiver sending the data in packets conformingto an IEEE 802.11 standard for wireless networks.

In one embodiment, Ogg data received by the processing system at 15 KHz,resulting in a stream data rate of approximately 2.5 Kbps per stream. Inone embodiment, buffer 814 (ADPCM buffer) has a capacity of 25 kilobytes(Kb) and buffers 816 and 818 (Ogg buffers) have a capacity of 10 Kb. Inone embodiment, the transceiver sends 512 byes of data per frame,comprised in part of audio data, with roughly corresponding to 60 framesper second. In such case, 128 bytes of the 512 bytes may be Ogg data,which is generally sufficient to seamlessly play Ogg data as 86 bytesper frame are generally necessary to play Ogg data seamlessly on, forexample, a handheld game device. Also, in this one embodiment, another128 bytes of the 512 bytes can be ADPCM data. In one embodiment, oneaudio stream corresponds to the bass part of a song, a second audiostream corresponds to the guitar part of the song, and a third audiostream corresponds to all other sounds in the song.

In one embodiment, different audio stream formats can be used for any ofthe audio streams. In another embodiment, more than two types of audiostreams can be used. In one embodiment, other buffer sizes can be usedfor any of the buffers. In other embodiments, less than or more thanthree buffers can be used. In one embodiment, a different wirelesscommunication standard can be used. In such case, the processor cancompose, and the transceiver can send, packets in accordance with thealternative wireless communication standard. In one embodiment, theprocessing system can be implemented using one or more Advanced RISCMachine (ARM) type processors, multiple random access memories (RAMs)and other appropriate circuitry. In another embodiment, the processingsystem can include any number of FPGAs, PLDs, CPLDs, RAMs and/or logiccircuits.

FIG. 9 is a partial block diagram of a further client system,particularly as it relates to audio streaming, in accordance withaspects of the invention. The audio stream receiver system includes awireless communication system 904, a processing system 902, a soundgenerator 906 and two speakers 908, 910. The wireless communicationsystem 904 includes an antenna 901, a transceiver 912 and a buffer 914.The antenna 901 is coupled to the transceiver 912 which is coupled tobuffer 914. Processing system 902 includes a processor 922 and threebuffers 916, 918, 920. Processor 922 is coupled to buffer 914 of thewireless communication system 904 and to buffer 916, buffer 918 andbuffer 920. Processor 922 is also coupled to sound generator 906 vialink 924. Link 924 includes 16 digital channels where each channelrelates to audio content. Sound generator 906 is connected to twospeakers 908, 910.

In operation, transceiver 912 receives data via antenna 901. The datamay be, for example, in accordance with an 802.11 wireless communicationstandard. The transceiver stores the data in buffer 914. Processor 922retrieves the stored data from buffer 914, parses the data (stream), andseparates it into the three underlying audio data streams, including afirst stream (ADPCM) and two second streams (Ogg). Each audio stream isstored in a respective buffer. The processor 922 decompresses the audiodata from each stream using the appropriate decompression process (e.g.ADPCM or Ogg decompression processes). The processor 922 combines thethree streams of audio data into 16 audio data channels and outputs the16 audio data channels via link 924 to sound generator 906. Soundgenerator 906 processes the 16 channels of digital audio data andgenerates two analog audio outputs. Speakers 908 and 910 receive theanalog audio outputs and produce sound.

In one embodiment, different audio stream formats can be used. Inanother embodiment, more than two types of audio streams can be used. Inone embodiment, the buffers of processing system 902 mirror the buffersof processing system 802 (FIG. 8). In one embodiment, other buffer sizescan be used for any of the buffers. In one embodiment, a differentwireless communication standard can be used. In such case, thetransceiver can receive, and the processor can process, packets inaccordance with the alternative wireless communication standard. In oneembodiment, the processing system can be implemented using one or moreAdvanced RISC Machine (ARM) type processors, multiple random accessmemories (RAMs) and other appropriate circuitry. In another embodiment,the processing system can include any number of FPGAs, PLDs, CPLDs, RAMsand/or logic circuits. In one embodiment, less than or more than twospeakers can be used. In one embodiment, more than or less than 16 audiodata channels can be used to provide the audio data from the processingsystem to the sound generator. In one embodiment, no sound generator isused and the processing system outputs one or more analog audio signals.

FIG. 10 is a flowchart illustrating a method for operating a processorin accordance with aspects of the invention. The processor may be, forexample, the processor of the system of FIG. 9. In block 1000 theprocessor receives data from, for example, the wireless system 904 ofFIG. 9. The processor separates the received data into audio streams. Inblock 1002 the processor stores the audio streams. In block 1004 theprocessor decompresses the audio data in the streams using theappropriate decompression processing. In block 1006 the processorcombines the audio streams 1006. In block 1008 the processor outputs acombined audio stream. In one embodiment the combined audio streamoutput includes 16 channels of audio data. In other embodiments, theprocessing system outputs one or more analog audio signals indicative ofthe combined audio stream.

The invention provides for streaming data, such as music data, duringgame play. Although the invention has been described with respect tocertain specific embodiments, it should be recognized that the inventionmay be practiced other than as specifically discussed, the inventionincluding the claims and their insubstantial variations supported bythis disclosure.

1. A method for providing audio information from a first handheld deviceto a second handheld device during game play of an interactivemultiplayer video game engaged in by users of the first handheld deviceand the second handheld device, the first handheld device configured toexecute program instructions of the interactive multiplayer video gameand the second handheld device also configured to execute programinstructions of the game, each of the first handheld device and thesecond handheld device having wireless communications capability,comprising: executing at least some program instructions of theinteractive multiplayer video game by the first handheld device;transmission of at least some audio information by the wirelesscommunications capability of the first handheld device; executing atleast some program instructions of the interactive multiplayer videogame by the second handheld device; reception by the wirelesscommunications capability of the second handheld device of the at leastsome audio information transmitted by the wireless communicationcapability of the first handheld device, the reception occurring afterthe second handheld device has executed at least some of the programinstructions of the interactive multiplayer video game; providing anaudio presentation by the second handheld device of the at least someaudio information received by the second handheld device; and executingat least some further program instructions of the interactivemultiplayer video game by the first handheld device, the execution ofthe at least some further program instructions occurring after thetransmission of the at least some audio information by the wirelesscommunications capability of the first handheld device.
 2. The method ofclaim 1 wherein the at least some program instructions of themultiplayer game and the at least some further program instructions ofthe interactive multiplayer video game are the same programinstructions.
 3. The method of claim 1 wherein the interactivemultiplayer video game is a multiplayer music game.
 4. The method ofclaim 1 wherein the at least some audio information is a portion of asong.
 5. The method of claim 4 wherein the at least some audioinformation includes audio information in a first data format and audioinformation in a second data format.
 6. The method of claim 1 whereinthe interactive multiplayer video game is a multiplayer music game inwhich users of the handheld devices simulate play of a song inaccordance with instructions to the users of the handheld devices;wherein the at least some audio information comprises portions of thesong; and further comprising: providing instructions to a user of thesecond handheld device to simulate play of the song, the instructionsindicating to the user of the second handheld device timing andoperation of input devices of the second handheld device; not providingthe audio presentation by the second handheld device of the at leastsome audio information received by the second handheld device if thesecond handheld device determines in accordance with programinstructions of the multiplayer game that the user of the secondhandheld device has not simulated play of the song in accordance withthe instructions; and transmission of further audio information by thewireless communications capability of the first handheld devicesubstantially throughout play of the interactive multiplayer video gameby the first handheld device.
 7. A method for use in communicating audioinformation from a first handheld device to a second handheld device,the method comprising: providing a first audio stream in a first dataformat; providing a second audio stream in a second data format, thesecond data format being different from the first data format; combiningthe first audio stream and the second audio stream into an outputstream; and transmitting the output stream from the first handhelddevice to the second handheld device.
 8. The method of claim 7, wherein:the first data format is Ogg; and the second data format is ADPCM. 9.The method of claim 7, wherein the first handheld device and the secondhandheld device are each a handheld game device.
 10. The method of claim7, wherein the transmitting the output stream from the first handhelddevice to the second handheld device is performed in accordance with an802.11 standard.
 11. The method of claim 7, wherein: the providing afirst audio stream in a first data format comprises loading data of thefirst audio stream from a memory cartridge.
 12. A method for use incommunicating audio information from a first handheld device to a secondhandheld device, the method comprising: receiving an input stream at thesecond handheld device from the first handheld device, the input streamincluding data of a first audio stream in a first format and data of asecond audio stream in a second format, the first data format and thesecond data format being different formats; decompressing data of thefirst audio stream; decompressing data of the second audio stream; andplaying at least one sound indicative of data of the first audio streamand data of the second audio stream.
 13. The method of claim 12,wherein: the first data format is Ogg; and the second data format isADPCM.
 14. The method of claim 12, wherein receiving an input stream atthe second handheld device from the first handheld device is performedin accordance with an 802.11 standard.
 15. The method of claim 12,wherein the first handheld device and the second handheld device areeach a handheld game device.
 16. The method of claim 12, furthercomprising combining the data of the first audio stream and the data ofthe second audio stream into at least one output audio signal, whereinthe playing at least one sound indicative of data of the first audiostream and data of the second audio stream includes playing at least onesound indicative of the at least one output audio signal on at least onespeaker.
 17. An audio stream transmitting system for transmittinginformation from a first handheld device to a second handheld device,the audio stream transmitting system comprising: a first bufferconfigured to receive a first audio stream in a first format; a secondbuffer configured to receive a second audio stream in a second format,the second data format being different from the first data format; aprocessor configured to combine the first audio steam and the secondaudio stream into an output stream; and a transmitting system configuredto transmit the output stream from the first handheld device to thesecond handheld device.
 18. The audio stream transmitting system ofclaim 17, wherein: the first data format is Ogg; and the second dataformat is ADPCM.
 19. The audio stream transmitting system of claim 17,further comprising a third buffer configured to receive data of theoutput stream.
 20. The audio stream transmitting system of claim 17, thetransmitting system is configured to transmit data in accordance with an802.11 standard.
 21. The audio stream transmitting system of claim 17,further comprising a memory cartridge configured to provide data of thefirst audio stream and data of the second audio stream.
 22. An audiostream receiving system for receiving information at a second handhelddevice from a first handheld device, the audio stream receiving systemcomprising: a receiving system configured to receive an input streamfrom the second handheld device, where the input stream includes a firstaudio stream in a first format and a second audio stream in a secondformat, the second data format being different from the first dataformat; a processor configured to retrieve the first audio stream fromthe input stream and to store the first audio stream in a first buffer;the processor configured to retrieve the second audio stream from theinput stream and to store the second audio stream in a second buffer;the processor configured to generate at least one audio signalindicative of the first audio stream and the second audio stream; and atleast one speaker configured to play a sound indicative of the at leastone audio signal.
 23. The audio stream receiving system of claim 22,wherein: the first data format is Ogg; and the second data format isADPCM.
 24. The audio stream receiving system of claim 22, the receivingsystem is configured to receive data in accordance with an 802.11standard.
 25. The audio stream receiving system of claim 22, wherein theprocessor is configured to: decompress data of the first audio stream;and decompress data of the second audio stream.